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Abstract 


This  paper  is  about  a  property  of  certain  combinatorial  structures,  called 
sequential  convexifiability,  shown  by  Balas  [1974,  1979]  to  hold  for  facial 
disjunctive  programs.  Sequential  convexifiability  means  that  the  convex  hull 
of  a  nonconvex  set  defined  by  a  collection  of  constraints  can  be  generated  by 
imposing  the  constraints  one  by  one,  sequentially,  and  generating  each  time 
the  convex  hull  of  the  resulting  set.  Here  w&  extend  the  class  of  problems 
considered  to  disjunctive  programs  with  infinitely  many  terms,  also  known  as 
reverse  convex  programs,  and  give  necessary  and  sufficient  conditions  for  the 
solution  sets  of  such  problems  to  be  sequentially  convexifiable.  We  point  out 
important  classes  of  problems  in  addition  to  facial  disjunctive  programs  (for 
instance,  reverse  convex  programs  with  equations  only)  for  which  the 
conditions  are  always  satisfied.  Finally,  we  give  examples  of  disjunctive 
programs  for  which  the  conditions  are  violated,  and  so  the  procedure  breaks 
down. 


0.  Introduction 


A  procedure  has  been  proposed  in  Balas  [1974,  1979]  for  the  sequential 
generation  of  the  convex  hull  of  feasible  solutions  to  the  system  of  constraints 
of  a  disjunctive  programming  problem.  The  idea  behind  the  procedure  in 
general  terms  is  the  repetition  of  a  partial  convex  hull  operation  of  the 
following  kind. 

Consider  an  optimization  problem  whose  solution  set  is  nonconvex.  Its 
constraints  may  include  linear  or  nonlinear  inequalities,  integrality  constraints, 
logical  conditions  (implications,  disjunctions,  etc.)  or  whatever.  Take  a 
subsystem  of  these  constraints  and  form  the  convex  hull  of  its  solution  set. 
It  is  a  partial  convex  hull  relative  to  the  convex  hull  of  the  set  of  solutions  to 
the  full  system  of  constraints.  Next,  intersect  this  partial  convex  hull  with 
the  solution  set  of  a  second  subsystem  consisting  of  constraints  not  included 
in  the  first  subsystem.  Finally,  form  the  convex  hull  of  the  intersection. 

Under  what  conditions  is  the  product  of  this  partial  convex  hull  operation 
the  convex  hull  of  solutions  to  the  augmented  subsystem  formed  by  appending 
the  constraints  of  the  second  subsystem  to  those  of  the  first?  Once  aware  of 
them,  we  can  try  to  maintain  these  conditions  through  a  number  of  repetitions 
of  the  operation,  each  enlarging  the  augmented  subsystem  by  appending  still 
unincorporated  constraints  until  the  complete  system  is  formed.  If  we 
succeed,  the  result  will  be  the  convex  hull  of  solutions  to  the  complete  system. 

A  procedure  that  generates  the  convex  hull  of  a  nonconvex  set  in  this 
sequential  manner  will  be  called  a  sequential  convexification  procedure.  A  set 
whose  convex  hull  can  be  generated  in  this  manner  will  be  called  sequentially 
convexifiable. 

Sequential  convexifiability  has  both  practical  and  theoretical  implications. 
Sequential  convexification  is  often  a  more  efficient  procedure  than  the 


alternative  of  imposing  all  the  constraints  simultaneously  and  generating  the 
convex  hull  of  the  resulting  set.  Besides,  the  procedure  involves  a  number  of 
iterations  bounded  by  the  number  of  constraints. 

The  question  as  to  when  precisely  is  a  nonconvex  set  sequentially 
convexifiable  was  given  a  partial  answer  in  the  context  of  disjunctive 
programming  by  Balas  [1974,  1979],  in  the  form  of  a  sufficient  condition  for 
the  convex  hull  of  a  disjunctive  set  to  be  obtainable  in  the  sequential  manner 
outlined  in  the  preceding  paragraph.  It  requires  the  disjunctive  program  to 
be  facial,  a  property  (to  be  specified  below)  general  enough  to  be  shared  by 
all  pure  or  mixed  0-1  programming  problems,  but  not  shared  by  general 
integer  programs.  On  the  other  hand,  the  question  of  a  necessary  condition 
for  the  validity  of  the  sequential  convexification  procedure  has  remained  open 
until  this  writing. 

The  present  paper  addresses  this  open  question.  However,  in  so  doing  it 
also  places  the  question  of  sequential  convexification  in  a  somewhat  more 
general  context,  in  that,  instead  of  disjunctive  programs  with  finitely  many 
terms  in  each  disjunction,  it  considers  the  class  of  reverse  convex 
programming  problems,  which  can  be  viewed  as  disjunctive  programs  involving 
disjunctions  with  infinitely  many  terms.  To  be  specific,  we  consider  problems 
whose  constraint  set  is  of  the  form 

gi(x)>0,  i  =  1,  2,  ....  m 

where,  for  each  i,  g^  is  a  convex  function  from  Rn  to  R.  In  a  disjunctive 
programming  problem  with  finitely  many  terms  in  each  disjunction,  each 
g^  is  either  linear  or  piecewise  linear  and  convex.  In  the  former 
case  it  is  called  a  conjunctive  constraint.  In  the  latter  case  it  is  called  a 
disjunctive  constraint  and  is  written  as  a  disjunction,  each  term  of  which  is  a 
linear  constraint.  This  form  of  the  constraint  set  is  known  as  the  conjunctive 


normal  form .  Thus  the  class  of  reverse  convex  programs  considered  here 
corresponds  to  disjunctive  programs  stated  in  conjunctive  normal  form,  whose 
disjunctions  may  have  infinitely  many  terms. 

The  sequential  convexification  procedure,  as  proposed  in  Balas  [1974, 
1979],  applies  to  facial  disjunctive  programs,  i.e.  those  in  which  every  term  of 
every  disjunction  is  a  linear  inequality  that  induces  a  face  of  the  polyhedron 
defined  by  the  conjunctive  inequalities.  It  begins  with  the  subsystem 
consisting  of  all  the  conjunctive  constraints  of  the  problem.  It  continues  by 
appending  one  piecewise  linear  (or  disjunctive )  constraint  to  the  growing 
subsystem  with  each  repetition  of  the  partial  convex  hull  operation.  The 
procedure  to  be  considered  here  for  the  more  general  case  of  reverse  convex 
programs  retains  this  feature  of  introducing  the  constraints  not  included  in 
the  initial  subsystem  one  by  one.  The  main  result  of  our  paper  is  a 
necessary  and  sufficient  condition  for  the  partial  convex  hull  operation  to 
work  as  desired  when  only  one  reverse  convex  constraint  is  introduced  at  a 
time.  The  Constraint  Boundary  Condition,  as  we  call  it,  is  weaker  than  the 
condition  of  faciality  when  applied  to  a  disjunctive  program  with  finitely  many 
terms.  However,  while  faciality  can  be  determined  prior  to  the  initiation  of 
the  procedure,  this  may  not  be  true  of  our  condition:  it  may  be  necessary  to 
check  each  time  the  convex  hull  operation  is  repeated  whether  the  Constraint 
Boundary  Condition  holds.  On  the  other  hand,  since  it  is  a  necessary  as  well 
as  sufficient  condition  for  the  partial  convex  hull  operation  to  yield  the 
desired  product,  the  Constraint  Boundary  Condition  imposes  the  weakest 
possible  restriction  on  the  constraints  involved.  The  Constraint  Boundary 
Condition  involves  pairs  of  points  satisfying  the  first  subsystem  of  constraints 
considered  in  a  partial  convex  hull  operation,  during  which  the  (partial) 
convex  hull  of  the  system  is  formed.  Often  this  convex  hull  is  a  polytope  (see 
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next  paragraph),  and  in  that  case  it  i8  only  necessary  to  consider  pairs  of 
vertices  of  the  polytope,  which  makes  the  Constraint  Boundary  Condition 
finitely  checkable. 

The  study  of  reverse  convex  programs  goes  back  to  Rosen  (1966),  who 
investigated  such  problems  in  a  control  theoretic  setting.  For  a  general 
discussion  of  important  aspects  of  reverse  convex  programming,  also  called 
complementary  convex  programming,  see  Avriel  (1976).  Particularly  relevant  to 
the  present  paper  is  the  study  of  Hillestad  and  Jacobsen  (1980).  They  have 

shown  that  the  convex  hull  of  feasible  solutions  to  a  reverse  convex 

programming  problem  is  a  polytope  subject  to  certain  differentiability  and 
compactness  assumptions.  In  this  case,  given  a  linear  objective  function, 
knowledge  of  the  convex  hull  enables  one  to  solve  the  problem  by  linear 

programming. 

Our  paper  is  organized  as  follows.  In  section  1  we  state  the  Constraint 
Boundary  Condition  and  show  that  it  is  necessary  and  sufficient  for  the 

success  of  the  partial  convex  hull  operation.  We  also  state  an  alternative 
sufficient  condition  for  the  finite  case,  which  is  usually  easier  to  check.  In 
section  2  we  give  a  formal  statement  of  the  sequential  convexification 
procedure  and  show  how  its  success  depends  upon  the  Constraint  Boundary 
Condition  being  satisfied  for  every  pair  of  sets  in  a  certain  sequence 
generated  by  the  procedure.  In  section  3  we  discuss  some  important  special 
cases  in  which  the  Constraint  Boundary  Condition  is  always  satisfied  and 
hence  the  sequential  convexification  procedure  always  works.  Finally,  in 
section  4  we  illustrate  on  a  job  shop  scheduling  problem  the  circumstances 
under  which  the  sequential  convexification  procedure  may  break  down,  and  the 
way  these  circumstances  may  be  avoided  by  a  slightly  different  problem 
formulation. 
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1.  A  Basic  Relation 


When  will  the  partial  convex  hull  operation  yield  the  desired  product?  The 
partial  convex  hull  operation  is  binary  inasmuch  as  it  operates  upon  two  sets. 
On  the  one  hand,  there  is  the  set  of  elements  satisfying  a  subsystem  of  the 
constraints  of  an  optimization  problem.  On  the  other  hand,  there  is  the  set  of 
elements  satisfying  an  additional  constraint.  The  operation  consists  in 
intersecting  the  convex  hull  of  the  former  with  the  latter  and  forming  the 
convex  hull  of  the  intersection.  The  desired  product  is  the  convex  hull  of 
elements  satisfying  the  augmented  system  consisting  of  the  first  subsystem 
with  the  additional  constraint  appended  to  it.  In  this  section  that  opening 
question  is  appropriately  qualified,  recast  in  formal  terms,  and  answered. 

The  partial  convex  hull  operation  was  conceived  in  connection 
with  disjunctive  programming  problems.  In  that  context  the  additional 
constraint  is  disjunctive.  It  has  the  form  g(x)  >_  0  where 

g(x)  =  max ( a . x-b . )  and  the  linear  functions  a.x  -  b.  are  finite  in  number. 

.11  li 

l 

The  complement  of  the  solution  set,  C  =  {x  |  g(x)  <  0},  if  nonempty,  is  an 
open  convex  polyhedron  of  full  dimension.  Thus  the  imposition  of  the 
additional  constraint  can  be  viewed  as  the  exclusion  from  the  solution  set  of 
the  elements  in  C.  The  set  resulting  from  the  intersection  of  multiple 

disjunctive  constraints  of  this  kind  can  be  thought  of  as  formed  by 
discarding  a  union  of  open  convex  sets. 

In  the  present  context,  the  class  of  constraints  eligible  to  fill  the  role  of 

single  additional  constraint  in  the  partial  convex  hull  operation  consists  of 

reverse  convex  constraints.  Each  of  these  must  be  such  that  the  set  of 

elements  not  satisfying  it  is  open,  convex,  and  of  full  dimension.  If  C 
denotes  this  set,  then  it  can  be  defined  via  a  convex  function 
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g:  R"  -  R  as  C  =  {x  |  g(x)  <  0}.  The  solution  set  for  the  constraint  is 
represented  as  its  complement,  'C  :  (x  |  g(x)  >  0). 

The  question  of  interest  is  now  recast  in  formal  terms  as  follows.  Let  P 
represent  the  set  of  solutions  to  the  subsystem  of  constraints.  Let  ~C 
represent  the  set  of  elements  satisfying  the  additional  reverse  convex 
constraint.  The  partial  convex  hull  operation  intersects  conv  P  and  ~C,  which 
yields  (conv  P)~C,  and  forms  the  convex  hull  of  the  result.  So  the  product  of 
the  partial  convex  hull  operation  is  conv[ (conv  P)~C].  The  set  of  solutions  to 
the  augmented  system,  on  the  other  hand,  is  just  the  intersection  of  P  and 
~C.  So,  in  formal  terms,  for  arbitrary  P  and  for  C  open,  convex  and  of  full 
dimension  the  question  of  interest  is  to  know  when  the  following  Basic 
Relation  is  true: 

(1.1)  conv[(conv  P)~C]  =  conv(P~C). 

Because  (conv  P)~C  £  P~C,  it  is  always  the  case  that  conv[(conv  P)~C] 
£  conv(P~C).  The  main  result  of  our  paper  is  that  the  reverse  inclusion 
holds  if  and  only  if  the  following  condition,  called  the  Constraint  Boundary 
Condition,  is  satisfied. 

(1.2)  If  x  e  P  fl  C  and  y  e  P~C,  then  [x,y]  H  bd  C  e  conv(P-'C). 

Here  [x,y]  denotes  the  line  segment  between  x  and  y  and  bd  C  denotes 
the  boundary  of  C  in  the  affine  space  spanned  by  C.  Observe  that  since  C 
is  full  dimensional,  [x,y]  fl  bd  C  t  0. 

Theorem  1.1.  The  sets  P  and  C  satisfy  the  Basic  Relation  (1.1)  if  and  only 
if  they  satisfy  the  Constraint  Boundary  Condition  (1.2). 

The  "if"  part,  which  is  the  main  content  of  Theorem  1.1,  says  that  in 
order  to  ascertain  that  all  points  of  (convP)~C  belong  to  conv(P~C),  it  is 


sufficient  to  check  that  all  those  points  on  the  boundary  of  C  that  are  the 

convex  combination  of  just  two  points  of  P,  belong  to  conv(P~C).  The  "only 

if"  part  states  the  easily  verifiable  converse. 

The  proof  of  Theorem  1.1  will  make  use  of  the  following  auxiliary  result. 

L^ma  1.2.  Let  x y  .  e  IR77,  i  =  1,  ...,  h;  J  =  1 ,  ,  k;  and  let  z  .  .  £ 

-I  J  ^  0 

[x  ,y  .]  be  given  for  all  pairs  i,  j.  Then  for  all  x  t  conv{x j, . . .  ,x^j 
and  y  t  conv{y j,  . . . , 

J  =  1,  . . . ,  k}  is  nonempty. 

Proof.  By  contradiction.  If  [x,y]  n  conv{z.  .  |  i=l,...,h;  j=l,...,k}  =  *, 

J 

then  there  exists  a  hyperplane  which  strongly  separates  the  line  segment  [x,y] 

from  the  polytope  conv{z.  .  |  i=l,...,h;  j=l,...,k}  (Cf.  Rockafellar  (1970), 

•  J 

Theorem  11.4).  Hence  the  hyperplane  defines  an  open  halfspace  H+  which 

contains  [x,y]  but  does  not  contain  any  z„.  On  the  other  hand,  because 

x  £  H*  and  y  e  H*  we  must  have  at  least  one  x.  and  at  least  one  y.  in  H4.  But 

^  J 

for  this  x^  and  this  y^  we  must  have  [x^,y^],  and  hence  z„,  in  H4" ,  which  is 
a  contradiction.  □ 

Proof  of  Theorem  1.1.  Assume  that  (1.1)  holds.  Let  x  e  P  H  C  and  y  e 
P~C,  and  let  w  =  [x,y]  H  bd  C.  Because  x  e  P  and  y  e  P,  we  conv  P. 
Moreover,  as  C  is  open,  C  O  bd  C  =  ♦  and  w  i  C.  ThuB  w  e  (convP)'C  £ 
conv[ (conv  P)~C]  =  conv(P~C),  where  the  equality  holds  by  assumption. 

Conversely,  assume  that  (1.2)  holds.  As  remarked  above,  it  is  sufficient 
to  show  that  conv[(conv  P)~C]  £  conv(P~C).  So,  suppose  that  z  is  a  point  of 
conv[(conv  P)~C].  (If  conv[(conv  PJ^C]  =  ♦,  then  so,  too,  for  the  included 
set,  conv(P~C)  =  ♦,  and  we  need  not  continue.)  Then,  by  Caratheodory’s 
Theorem,  z  can  be  expressed  as  a  convex  combination  of  finitely  many  points  r 
e  (conv  P)~C.  In  turn  each  such  r  can  be  expressed  as  a  convex  combination 
of  finitely  many  points  of  P.  For  each  such  r,  because  r  /  C  and  C  is  convex, 


yjJ,  the  set  [x,y]  H  conv{z_.j  |  i  =  1, 


the  points  of  P  in  the  convex  combination  for  r  must  include  at  least 


one  point  in  P'-C.  On  the  other  hand,  each  r  which  is 

a  convex  combination  solely  of  points  in  P~C  must  belong  to 

conviP'-C).  In  order  to  conclude  that  z  s  conv(P~C),  we  need  only 

show  that  those  r  which  are  not  convex  combinations  of  points  solely 

in  P~C  are  also  in  conv(P~C).  So  assume  that  r  can  be  expressed  as  a 

convex  combination  of  the  points  x^,  . ..,  x^,  y^,  y^  where  h,  k  >  1  and 

x.  t  P  fl  C,  each  y.  t  P~C.  For  each  pair  x. ,  y.  define  z.  .  =  [x.,y]  fl  bd 
i  j  i  j  ij  i  j 

C.  Hence  z.  .  t  cl  C  (cl  denotes  the  closure).  By  the  Constraint  Boundary 
1  J 

Condition  (1.2),  z.  .  e  conv(P~C).  Furthermore,  by  collection  of  terms, 

^  J 

r  can  in  this  instance  be  expressed  as  a  convex  combination  of  just  two 


points  x  t  conv{Xj, . . . ,x^}  and  y  t  conv{y^, . . . ,y^} .  That  is,  r  is  on  the 


closed  line  segment  [x,y]. 


By  Lemma  1.3  there  exists  w  e  [x,y]  fl 


conv {  z .  .  |  i=l,...,h;  j=l,...,k}.  So  [x,y]  =  [x,w)  U  [w,y],  and 

^  J 

either  r  i  [x,w)  or  r  «  [w,y].  Now  w  t  cl  C  as  z.  .  c  cl  C  for  all  i,  j. 

^  J 

Similarly,  w  t  conv(P~C)  as  z^  t  conv(P~C)  for  all  i,  j.  Since  x  s  C  =  int  C 
( int  denotes  interior)  and  w  c  cl  C,  we  have  [x,w)  £  C,  while,  as  w  and  y 
are  in  conv(P~C),  so  too  is  [w,y].  The  fact  that  r  4  C  then  implies  r  c  [w,y] 
and  r  c  conv(P*<l).  So  each  r  is  in  conv(P~C),  and  z,  as  a  convex 
combination  of  them,  is  there  as  well.  Therefore,  conv[(conv  P)~Cl  £ 

conv(P~C).  a 


For  the  case  of  a  disjunctive  program  with  finitely  many  terms  in  each 


disjunction,  we  give  a  sufficient  condition  for  the  Basic  Relation  to  hold, 
which  is  often  easier  to  check  than  (1.2).  Let  HT  =  fx  |  d'x 
>  i  1  Q,  be  finitely  many  halfspaces  of  the  space  containing  P. 


Theorem  1.3.  The  Basic  Relation 


(1.1}  conv( (convP)  '€)  -  conv(P'O), 

where  "C  -  U  //y,  is  satisfied  if  the  relation 
it  Q 

(1.3)  ( convP)  H~.  =  conv(P1MT.) 

is  satisfied  for  every  i  t  Q. 

Proof.  Suppose  (1.3)  holds  for  every  i  t  Q.  Then 

conv( (convP )~C)  =  conv( (convP) M (  U  If)) 

i*Q  1 

=  conv  U  ( (convP)  HH-) 
itQ  1 

=  conv  U  conv(PflHT) 
itQ  1 

=  conv  U  (PHIT) 

UQ  1 

=  conv  ( P  H  (  U  HT ) ) 
itQ  1 

=  conv(P~C). 

Here  the  first  and  last  equations  were  obtained  by  using  ~-C  -  U  HT • 

itQ  1 

the  second  and  next  to  last  equations  use  the  fact  that  O  is  distributive  with 
respect  to  U,  the  third  equation  follows  from  (1.3)  (which  is  assumed  to  hold), 
while  the  fourth  equation  uses  the  obvious  relation  convfconvS  U  convT)  = 
conv(SUT),  true  for  arbitrary  sets  S,  T.  □ 

While  (1.3)  is  sufficient  for  (1.1)  to  hold,  it  is  not  necessary.  To 
see  this,  let  P  £  IP2,  P  =  { ( 1 , 1 ) ,  (-1 , 1 ) }  and  ~C  =  U  H~,  where  H~ 

=  (x  £  R2  |  +  x2  -  3/2,  =  {x  t  IR2  |  -Xj  +  >  3/2).  We  have  P~C  =  P, 

conv(P~C)  -  conv  P  =  conv (( convP) ~C) ,  i.e.  (1.1)  holds.  On  the  other 
hand,  P  f)  Hj  =  ((1,1)}  =  conv(PHH^),  whereas  conv  P  -  (x  t  IR2  j  x  =  ( 1 ,  1 )  X  + 
( - 1 , 1 ) ( 1-X ) ,  0  <  X  <  1},  and 

x  -  ( 1 , 1 )X  +  (-1, 1) ( 1  -X) ,  0  <  X  <  1 

(convP)  fl  HT  =  x  £  R“ 

Xi  +  x2  >  3/2 


Clearly,  conv(PHH^)  jj  (convP)  n  i.e.  (1.3)  does  not  hold. 

Relation  (1.3)  is  equivalent  to  a  condition  that  has  an  appealing 

geometric  interpretation.  We  will  say  that  HT  (or  H.,  where  IT  =  bd  HT) 

satisfies  the  Window  Condition  with  respect  to  P  if  the  following  is  true: 

(1.4)  If  x  £  P~H“  and  y  e  P  O  HT,  then  [x,y]  H  H^  £  conv(PHH^). 

Requirement  (1.4)  can  be  interpreted  as  having  the  set  conv(PHH^)  act  as 

a  "window"  through  which  every  pair  of  points  lying  in  P  but  on  opposite 

sides  of  H. ,  can  "see  each  other." 
i 

Theorem  1.4 .  Equation  (1.3)  holds  if  and  only  if  the  Window  Condition 
(1.4)  holds. 

Proof.  Applying  Theorem  1.1  to  P  and  C  in  the  case  when  C  =  int  Ht 

(=~HT),  we  find  that  (1.3)  is  in  this  case  the  same  as  (1.1),  while  the 

Constraint  Boundary  Condition  (1.2)  becomes 

(1.2’)  If  x  e  P~HT  and  y  £  P  H  HT,  then  ([x,y]flH.)  £  conv(PHHT). 

The  Window  Condition  (1.4)  differs  from  (1.2’)  only  in  that  it  replaces 
HT  with  H^  on  the  righthand  side  of  the  last  expression.  Now  if  (1.4)  holds 
then  (1.2’)  clearly  does,  so  all  that  remains  to  be  shown  is  that  (1.2’) 
implies  (1.4).  Let  w  :=  [x,y]  H  H^ .  Since  w  e  H^  fl  conv(PHHT)  (from 

(1.2’)),  w  lies  on  the  face  of  conv  (PHHT)  contained  in  the  hyperplane  H^; 

hence  w  £  conv(PHH^) .  V 

Corollary  1.5.  Let  P  be  any  set,  and  ~C  =  U  H~..  Then  the  Basic 

itQ  1 

Relation  (1.1)  holds  if  the  Window  Condition  (1.4)  holds  for  every  hyperplane 
H i  £  0. 

l 

Proof.  Follows  from  Theorems  1.3  and  1.4. | 


2.  The  Procedure  For  Sequential  Generation  of  the  Convex  Hull 

In  this  section  we  give  a  formal  description  of  the  sequential 
convexification  procedure.  This  confirms  that  the  procedure  succeeds  if  upon 
each  repetition  of  the  partial  convex  hull  operation  the  two  sets  subjected  to 
the  operation  satisfy  the  Constraint  Boundary  Condition.  In  addition,  we 
provide  a  sufficient  condition  for  the  success  of  the  procedure  in  the  more 
general  version  which  adds  constraints  sequentially,  but  not  one  at  a  time. 

The  procedure  is  designed  for  problems  which  include  some  reverse 
convex  constraints,  each  of  which  is  such  that  the  set  of  points  satisfying  the 
constraint  has  a  complement  that  is  open,  convex  and  of  full  dimension.  If  the 
problem  has  other  kinds  of  constraints  as  well,  these  other  constraints  can  be 
included  in  the  initial  subsystem. 

The  procedure  consists  in  a  number  of  iterations  each  of  which  uses  the 
partial  convex  hull  operation  to  activate  a  single  one  of  the  constraints  so  far 
left  out.  The  constraint  is  made  active  by  intersecting  the  set  resulting  from 
the  preceding  iteration  with  the  set  of  points  satisfying  the  constraint,  and 
forming  the  convex  hull  of  the  intersection.  The  procedure  continues  until  all 
constraints  have  been  made  active.  The  desired  result  of  the  final  iteration 
is  the  convex  hull  of  the  set  of  solutions  to  all  the  constraints  of  the  problem. 

Our  approach  is  best  understood  by  viewing  the  activation  of  a  constraint 
at  an  iteration  of  the  procedure  as  a  narrowing  of  the  feasible  region  by 
excluding  from  consideration  an  open,  convex,  full-dimensional  set.  The  set 
excluded  is  the  complement  of  the  set  of  points  satisfying  the  constraint.  The 
procedure  could  be  viewed  as  consisting  of  the  sequential  exclusion  of  such 
sets.  From  this  perspective,  the  procedure  can  be  described  as  follows. 


Given  an  initial  subsystem  of  the  constraints,  denote  the  set 

of  solutions  to  this  subsystem  F^.  We  assume  £  R0.  Given  that  there 

are  m  remaining  constraints,  each  satisfied  by  a  set  of  points  whose 

complement  is  open,  convex,  and  of  full  dimension,  order  the 

constraints  and  denote  the  corresponding  open,  convex  complements  C, ,  . . . ,  C  . 

I  m 

m 

Set  C  =  U  C..  The  object  of  the  procedure  is  the  formation  of  the  convex 

j  =  l  J 

hull  of  the  set  F  given  by 

F  =  F, "C  =  F, ~  U  C.. 

1  1  j=l  J 

Alternatively,  F  can  be  described  by  successive  exclusion  of  the  sets  C.: 


F  =  ( (  ...  ( (F1~C1)~C2)  ...  )~Cm). 


At  the  j 


•  th 


iteration  the  procedure  forms  the  set  F^+^  E  defined 


recursively  as  F .  ,  =  (conv  F.)'-C.,  j  =  1,  ...,  m,  and  then  takes 
j  x  J  J 


its 


convex  hull. 


conv  Fj+j  will  be  compared  below  to  the  convex  hull  of  the  set 


G .  ,  defined  recursively  as 
J+l 


=  F, 


G  .~C  ., 
J  J 


Observe  that  G 


nr+1 


F. 


j  —  1 ,  *  •  . ,  ®» 


Theorem  2.1.  Let  F.  he  an  arbitrary  set,  and  let  C  .,  j  =  1,  .  .  . ,  m, 

x  J 

be  open  convex  sets  of  full  dimension,  ordered  into  an  arbitrary 


but  fixed  sequence.  Then  conv  F  .  =  conv  G  .  for  j  =  2,  ...,  a  +  1  if  and 

J  1 


only  if  the  Constraint  Boundary  Condition  holds  for  each  pair  G  .,  C  ., 

J  J 


j  -  1,  . .  . ,  m.  If  this  is  the  case,  then  in  particular  conv  F 


m+1 


conv  F. 


Proof.  Assume  that  the  Constraint  Boundary  Condition  (CBC)  holds  for  all 

pairs  G.,  C.,  j  =  1,  ...,  m. .  Apply  the  procedure  to  F, ,  F0,...,  F  . 

J  J  I  i  m 

the  first  step  we  have: 


After 


conv  =  conv[(conv  Fj)~C^]  (by  definition  of  Fg) 


=  conv [(conv  G^)~C^]  (since  F^  =  G^) 

=  conv(G^~C^)  (since  G^,  satisfy  the  CBC) 

=  conv  Gg  (by  definition  of  Gg). 


The  proof  continues  by  induction.  By  hypothesis,  after  step  j  -  1  we  have 

conv  F.  =  conv  G..  Therefore,  after  step  j  we  have: 

J  J 


conv  F  . , .  =  conv [ ( conv  F  . ) ~C  .  ] 
J+l  J  J 


=  conv[(conv  G.)~C.]  (by  the  induction  hypothesis) 
J  J 


=  conv(G  .~C  .) 

J  J 

=  conv  G. .  , . 

J+l 


(since  G.,  C.  satisfy  the  CBC) 
0  J 


After  m  steps,  since  G 


F,  we  have:  conv  F  .  =  conv  F. 

m+i 


Conversely,  if  the  Constraint  Boundary  Condition  fails  for  a  pair  G.,  C., 

J  J 


then: 


conv  F  .  t .  =  conv [ ( conv  F  . ) ~C  .  ] 

J+l  j'  JJ 

3  conv  [(conv  G.)~C.l  (since  F .  3  G.) 

J  J  J  ~  J 


a  conv(G  JC  ^ 

=  conv  G  . , . .  a 
J+l 


(by  Theorem  1.4) 


Two  comments  are  in  order  at  this  point,  each  of  which  reveals  a  certain 
weakness  of  our  procedure;  weaknesses  that  are  overcome  in  the  important 
special  cases  to  be  discussed  in  the  next  section. 

First,  note  that  for  the  sequential  convexification  procedure  to  be  valid, 


Theorem  2.1  requires  (1.2)  to  hold  for  each  pair  G.,  C.,  where  the  set  G. 

J  J  J 

is  in  the  role  of  P  and  C j  in  that  of  C.  The  feature  we  wish  to  point  out 

here  is  that  although  conv  G.  =  conv  F.,  where  F.  is  defined  recursively  as 

J  J  J 

conv  (F .  , ~C  ._. ) ,  it  is  not  sufficient  for  condition  (1.2)  to  hold  for  each 
J  -L  J 

pair  F.,  C..  In  other  words,  while  the  sequential  convexification  procedure 
J  J 

is  a  recursive  application  of  the  partial  convex  hull  operation  to  each  pair 


F.,  C.,  the  validity  of  the  procedure  hinges  on  a  condition  that  at  each  step 
J  J 

of  the  procedure  reaches  back  beyond  F  . ,  to  the  set  G  . .  This  of  course  makes 

J  J 

the  condition  harder  to  check. 

Second,  note  that  the  condition  given  in  Theorem  2.1  for  the  validity  of 

of  the  sequential  convexification  procedure  is  tied  to  a  certain  ordering 

of  the  constraints,  hence  of  the  pairs  G.,  C..  The  procedure  may  be  valid  if 

3  J 

the  constraints  are  imposed  in  a  particular  order  and  invalid  if  a  different 
ordering  is  used.  This  makes  a  negative  outcome  often  inconclusive:  in  order 
to  establish  that  the  procedure  is  inapplicable  to  a  certain  problem,  one  might 
have  to  explore  exponentially  many  sequences. 

Fortunately,  both  of  these  shortcomings  disappear  in  certain  special  cases 
which  are  rather  important;  they  will  be  discussed  in  the  next  section. 

Now  we  turn  to  the  case  of  a  disjunctive  program  with  finitely  many  terms 
in  each  disjunction,  and  give  a  sufficient  condition  for  the  validity  of  the 
sequential  convexification  procedure. 

Corollary  2.2.  Let  F.  and  C  .  be  as  in  Theorem  2.1,  with  'C  .  =  U  H~. 

7  ■>  J  jitfj  J‘ 

j  =  1,  where  each  0  is  finite  and  each  is  a  closed  halfspace. 

Then  conv  F  .  =  conv  G  .  for  j  =  2,  . . . ,  m  +  1  if  for  j  =  1,  .  . . ,  m  each 
J  J 

hyperplane  H . .  (=bd  H~. .)  satisfies  the  Window  Condition  (1.4)  with 
ji  ji 

respect  to  Gj. 

Proof.  Analogous  to  the  proof  of  sufficiency  in  Theorem  2.1,  with 
condition  (1.2)  replaced  by  (1.4).  □ 

In  the  Introduction  we  also  outlined  a  more  general  version  of  the 
procedure  which  involves  the  possibility  of  activating  several  constraints  at 
each  iteration.  An  iteration  of  this  version  consists  of  intersecting  the  result 
of  the  preceding  iteration  with  the  set  of  solutions  satisfying  several  of  the 


as  yet  unactivated  constraints.  Then  the  convex  hull  of  the  intersection  is 


formed.  Next  we  show  that  if  there  is  an  ordering  of  the  m  constraints  not 


included  in  the  initial  subsystem  such  that  each  pair  G.,  C.  satisfies  the 

J  J 

Constraint  Boundary  Condition,  then  a  procedure  which  activates  any  number 
of  the  still  inactive  constraints  at  each  iteration  will  be  successful.  However, 


if  several  constraints  are  activated  at  once,  then  they  must  be  selected 

consecutively  according  to  their  original  ordering. 

Theorem  2.3.  Let  Fj  be  an  arbitrary  set,  and  let  Cj,  J  -  1,  . ..,  m,  be 

open  convex  sets  of  full  dimension.  If  the  Constraint  Boundary  Condition 

holds  for  each  pair  G  ,  C  ,  J  =  1,  . . . ,  k  <_  m,  then 
k  J  J 

conv [(conv  Fj)  "(  U  C  .)]  -  conv 

J=1  k  k 

Proof.  On  the  one  hand,  (conv  F. )~(  U  C.)  £  F.~(  U  C.).  Therefore 

j=l  J  j=l  J 

k  k 

conv  [(conv  F.)~(  U  C.)]  £  conv[F..~(  U  C.)]  =  conv  G,  .. 

j=l  J  j=l  J 

On  the  other  hand,  the  opposite  inclusion  follows  by  induction.  By  Proposition 
2.1  it  holds  for  k  =  1.  Suppose  it  holds  for  k  =  i  -  1,  2  £  i  <  m,  and 
set  k  =  i.  Then 

k  k-1 

conv [(conv  F.)~(  U  C.)]  =  conv [(conv  F.)~(  U  C.)~C,  ] 

j=l  J  j=l 

£  conv [ conv [( conv  F.)~(  U  C.)]~C, ] 

1  j=l  J 

=  conv [(conv  Gk)~Ck]  (by  hypothesis) 


=  conv(Gk~€^) 

=  conv  0 


(by  the  CBC) 


.  »  .  r, 


3.  Sene  Special  Cases 

In  this  section  we  discuss  some  of  the  results  of  the  previous  sections  as 
they  apply  to  certain  special  cases. 

First,  there  are  situations  in  which  the  Constraint  Boundary  Condition 
(1.2)  holds  trivially.  One  case  of  this  kind  occurs  when  P  O  C  =  ♦,  Another 
one  when  P  fl  C  =  P.  In  the  first  case  there  is  no  x  e  P  M  C,  in  the  second 
one  there  is  no  y  *  P~C;  so  in  both  cases  the  condition  (1.2)  holds  trivially 
and  thus  from  Theorem  1.1,  the  Basic  Relation  (1.1)  also  holds. 

A  very  important  case  ,  with  interesting  subcases,  is  the  one  when  P  £  C 
but  P  £  cl  C.  Consider  for  instance  a  nonlinear  programming  problem  whose 
only  nonlinear  constraints  are  equations  involving  convex  functions,  i.e.  are  of 
the  form  g^(x)  =  0,  i  =  1,  . . . ,  m,  with  each  g^  a  convex  function  such  that 
(x  |  g  (x)  <  0}  f  ♦.  We  can  then  define  (i.e.  the  initial  set  P)  as  the 

set  of  points  satisfying  the  linear  constraints  plus  the  nonlinear 
inequalities  g^(x)  <0,  i  =  1,  . . . ,  m;  and  for  i  =  1 ,  ...,  m  let  C.  = 
fx  |  g^(x)  <  0},  i.e.  =  {x  |  g^(x)  >.0}.  On  the  one  hand,  this  makes  F^ 

convex,  hence  the  procedure  is  relatively  easy  to  start.  On  the  other  hand, 
with  the  chosen  definition  of  F^  and  of  the  sets  C^,  at  any  stage  of  the  pro¬ 
cedure  if  the  current  set  G  .  is  P  and  the  next  constraint  C  .  to  be 

J  J 

activated  is  C,  then  y  e  P~C  implies  y  *  bd  C  and  so  for  any  x  e  P  n  C,  we 
have  [x,y]  H  bd  C  =  { y } .  The  Constraint  Boundary  Condition  (1.2)  is  thus 
necessarily  satisfied.  In  other  words,  for  optimization  problems  whose  only 
nonlinear  constraints  are  equations  involving  convex  functions,  the  sequential 
convexification  procedure  always  works and  it  does  so  irrespective  of  the 
sequence  in  which  the  constraints  are  activated. 

Another  instance  when  P  £  C  but  P  £  cl  C  occurs  in  the  case  of  facial 
disjunctive  programs,  i.e.  problems  for  which  F.  (the  initial  set  P)  is  a 


polyhedron  given  by  a  set  of  linear  inequalities,  and  each  disjunctive 
constraint  is  of  the  form  .  =  U  H“ .  ,  with  Q.  finite  and  H~T .  a  closed 

j  .  ji  j  ji 

1  c  W  j 

halfspace  such  that  is  a  face  of  F^.  This  situation  is  again  easy 

to  recognize,  since  all  one  has  to  do  is  to  check  for  each  halfspace  H"jj  that 

the  inequality  defining  the  opposite  closed  halfspace,  Ht.,  is  among  the 

J  ^ 

inequalities  defining  F^ .  As  in  the  situation  discussed  earlier,  the 

sequential  convexification  procedure  is  then  applicable  without  any  need  for 
checking  the  Constraint  Boundary  Condition  and  the  constraints  may  be 
imposed  in  any  order  whatsoever. 

As  already  mentioned,  facial  disjunctive  programs  include  all  pure  or 

mixed  integer  0-1  programs.  The  fact  that  their  convex  hulls  can  be 

generated  sequentially  in  n  steps,  where  n  is  the  number  of  disjunctions, 

makes  it  possible  to  develop  cutting  plane  procedures  whose  finiteness  proof 

uses  this  property  (see  Jeroslow  [1980]  for  one  such  procedure). 

For  general  reverse  convex  programs,  conv  G.  is  often  a  polytope  (this 

J 

is  subject,  as  already  mentioned,  to  certain  differentiability  and  compact- 
pactness  assumptions;  see  Hillestad  and  Jacobsen  [1980]  for  details).  In 
this  case  conv  is  generated  by  a  finite  number  of  so-called  quasivertices , 
and  the  checking  of  the  Constraint  Boundary  Condition  can  be  restricted  to 
pairs  x,  y  of  such  quasivertices. 

4.  A  Job  Shop  Scheduling  Example. 

Consider  the  problem  of  scheduling  the  processing  on  n  jobs  on  one 

machine.  If  L.  denotes  the  earliest  time  job  j  can  be  started,  d.  .  the 
J  ij 

minimum  time  lapse  between  the  starting  of  job  i  and  that  of  job  j  (in  that 
order)  on  the  machine,  and  (the  variable)  t .  denotes  the  actual  starting  time 
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of  .job  j,  then  for  whatever  objective  function,  the  constraints  of  the  problem 
are 


(4.1) 


t  .  >  L . ,  j  *  N 
J  -  J 


t.  -  t.  >  d.  v  t.  -  t.  >  d..  ,  i,  j  t  N,  i  i  j 

J  i-ij  i  J-Ji 


where  N  =  (1,  ...»  n}.  This  is  a  disjunctive  set,  and  it  is  easy  to  see  that  it  is 
not  facial.  Indeed,  faciality  would  require  that  the  conditions 


t  .  -  t.  <  d.  . 

J  i  -  iJ 


t  .  +  t.  <  d  . . 

J  i  ~  Ji 


i»  j  *  N,  i  t  j 

be  added  to  the  constraints  of  (4.1),  which  would  obviously  change  the 
problem,  actually  make  it  infeasible  in  most  cases.  So  whether  the  sequential 
convexification  procedure  works  for  this  clasB  of  problems  is  an  open 
question.  We  will  show  by  way  of  a  small  example  that  it  does  not  work  in 
general. 


Bxample.  Let  n=3,  L^=0,  j  =  1,  2,  3,  and 


(du>  ■ 


*  2  4 

3*6 
2  2  * 


3  3 

Then  F^  =  R+  (the  positive  orthant  of  R  ),  and  each  disjunctive  con¬ 


straint  set  is  of  the  form  ~C. where 

iJ 


C.  .  =  {t  *  ir 

1J 


'  dji  <  ‘j  '  *i  <  dijK  i.  J  =  1.  2.  3;  t  ^  j). 


If  we  impose  the  constraints  in  the  order  ^^2’  ^23’  ~^13’  Proce(^ure 


generates  the  set 


conv  F^  = 


t  *  R 


2tl 

+ 

3t2 

> 

6 

3t„ 

+ 

t_ 

> 

6 

2 

3  - 

2t, 

t. 

> 

4 

1 

3  - 

4tl 

+ 

9t2 

+ 

2t3  * 

26 

*1 

+ 

CM 

00 

i-H 

+ 

st3  > 

38 
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The  sets  Fg  and  Fg  consist  of  those  t  t  R+  satisfying  the  first  con¬ 


straint,  and  the  first  two  constraints,  respectively,  of  F^.  So  the  last 


step  adds  three  constraints. 


Now  F.  is  not  the  convex  hull  of  F  :=  F.~(  U  C.  .).  The  latter  has, 
4  i,j=l  1J 


besides  the  three  facets  defined  by  the  nonnegativity  constraints  and  the 
three  facets  defined  by  inequalities  with  positive  coefficients  for  two  of  the 
three  variables,  another  four  facets  defined  by  inequalities  with  positive 
coefficients  for  all  three  variables  (see  Balas  [1984]  for  an  explanation  of  why 
this  is  so),  and  is  in  fact 


conv  F  = 


t  *  *r 


2tl 

+ 

CM 

+> 

co 

> 

6 

3t2 

+ 

t3 

> 

6 

2tl 

+ 

t3 

> 

4 

9tl 

+ 

llt2 

4* 

5t3 

> 

G2 

3tl 

+ 

*2 

+ 

*3 

> 

10 

14tl 

+ 

21t2 

+ 

iot3 

> 

112 

2t1 

+ 

33t2 

+ 

10tg 

> 

76 

So  the  sequential  convexification  procedure  does  not  work  in  this  case; 
namely,  it  breaks  down  at  the  third  iteration,  when  we  take  the  convex  hull  of 
Indeed 


(conv  F3)~C13. 


[  t 

_3 

t2  tl  ~ 

2  w  tl  *  t2  -  3 

G3  = 

1  ' 

R 

+ 

fc3  “  t2  - 

6  v  t2  ~  t3  -  2 

C13  -  1 

! 1  * 

R3 

|  -  2  C  tg  - 

■  h  ( 4 )  • 

Consider 

the 

points  x 

=  (0,2,0)  and  > 

x  1  Cjg,  while  y  t  C^g. 


Now  [x,  y]  H  bd  C^g  =  (2,2,0),  and  it  is  easy 


to  check  that  (2,2,0)  i  conv(Gjg-C^g)  =  conv  F,  as  (2,2,0)  violates  each 


of  the  last  four  inequalities  of  conv  F. 


Our  example  illustrates  the  fact  that  for  a  nonfacial  disjunctive  program 
the  sequential  convexification  procedure  may  not  work.  On  the  other  hand, 
any  bounded  disjunctive  program  can  be  restated  as  a  (pure  or  mixed  integer) 
0-1  program,  by  introducing  one  0-1  variable  for  every  term  of  every 
disjunction.  By  becoming  a  0-1  program,  the  disjunctive  program  acquires  the 
property  of  faciality,  and  lends  itself  --  in  its  new  form  —  to  the  sequential 
convexification  procedure.  This  is  a  rather  intriguing  fact,  in  view  of  the 
circumstance  that  the  inequalities  containing  the  0-1  variables  in  many 
instances  have  no  constraining  power  in  the  linear  programming  relaxation  of 
the  problem.  A  case  in  point  is  the  above  discussed  job  shop  scheduling 
problem,  whose  constraint  set  in  the  standard  0-1  programming  formulation 
becomes 


t . 

> 

L . , 

J 

J 

t , 

-  t.  +  My.  . 

> 

d.  . 

J 

1  IJ 

ij 

t . 

+  t.  -  My.  . 

> 

d..  -  M 

J 

i  IJ 

Ji 

yij 

c 

(0,  1},  i 

j  *  N 


j  c  N,  i  t  j. 

Here  M  is  a  sufficiently  large  number  to  serve  as  an  upper  bound  on  any 


of  the  differences  t.  -  t..  It  is  easy  to  see  that  if  the  0-1  condition 

J  i 

on  each  y.  .  is  relaxed  to  0  <  y.  .  <  1,  the  constraints  involving  the 
U  “  lj  ~ 

variables  y.  .  are  ineffective  in  the  sense  that  the  continuous  variables  t. 

iJ  J 

are  only  constrained  by  their  lower  bounds:  for  any  values  t.  >  L.,  j  i  N, 

J  J 

there  exist  associated  values  of  y.  .  satisfying  0  <  y.  .  <  1  and  all  the 

ij  -  ij  - 

remaining  inequalities.  Yet  the  disjunctive  constraints  are  now  of  the  form 


y.  .  <  0  w  y.  .  >  1,  with  each  y.  .  constrained  in  addition  by  0  <  y.  .  <  1. 
ij  -  ij  ~  lj  7  -  ij  ~ 


Clearly,  in  this  formulation  our  disjunctive  program  is  facial  and  thus  the 
sequential  convexification  procedure  is  valid  for  it. 


It  should  be  noted,  however,  that  although  from  this  particular  point  of 
view  there  is  an  advantage  in  representing  the  disjunctions  by  0-1  variables, 
for  other  purposes  a  direct  approach  often  yields  results  that  cannot  be 
obtained,  or  are  much  harder  to  obtain,  by  the  use  of  0-1  variables  (see  Balas 
[1985]  for  an  illustration  on  the  case  of  job  shop  scheduling). 
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reverse  convex  programs,  and  give  necessary  and  sufficient  conditions  for  the 
solution  sets  of  such  problems  to  be  sequentially  convexif iable .  We  point  out 
important  classes  of  problems  in  addition  to  facial  disjunctive  programs  (for 
instance,  reverse  convex  programs  with  equations  only)  for  which  the  conditions 
are  always  satisfied.  Finally,  we  give  examples  of  disjunctive  programs  for 
which  the  conditions  are  violated,  and  so  the  procedure  breaks  down. 
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